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Abstract 

Following |M2| , let Sn' 1 be the set of all coloured permutations on the symbols 
1,2 ,,n with colours 1 , 2,. .., r, which is the analogous of the symmetric group 
when r = 1, and the hyperoctahedral group when r = 2. Let I C {1,2, ...,r} 
be subset of d colours; we define T™ r (I) be the set of all coloured permutations 

(j) £ S^ such that (j )i = m^ where c £ I. We prove that, the number T™ r (I)~ 
avoiding coloured permutations in Sn'* equals ( k — l)!r fc_1 hj for n > k where 

hj = (r — d)j + (k—l)d. We then prove that for any </> £ T^ r {I) (or any (j) £ T^ r (/)), 
the number of coloured permutations in Sn^ 1 which avoid all patterns in T £ r (/) (or 
in Tj? r (I)) except for <j> and contain <j) exactly once equals YVj=k hj ' Yl!j=k 7T ^ or 
n> k. Finally, for any (j> £ T™ r (I), 2 < m < k — 1, this number equals nj=fc+i hj 
for n > k + 1. These results generalize recent results due to Mansour [Ml], and due 
to Simion [Hi ■ 


1. Introduction 

The main goal of this note is to give analogies of enumerative results on cer¬ 
tain classes of permutations characterized by pattern-avoidance in the symmetric 
group (see [Ml]), and in the hyperoctahedral group (see [i|]). In Sn' 1 (see ]M2|), 
the natural analogue of the symmetric group and of the hyperoctahedral group, 
we identify classes of restricted coloured permutations with enumerative properties 
analogous to results in the symmetric group and hyperoctahedral group. In the re¬ 
mainder of this section we present a brief account of earlier work which motivated 
out investigation, summarize the main results, and present the basic definitions 
used throughout the note. 


Pattern avoidance in the symmetric group proved to be a useful language in a 
variety of seemingly unrelated problems, from stack sorting 0 @ the theory 


of Kazhdan-Lusztig polynomials [Br|, singularities of Schubert varieties |LS 


Chebyshev polynomials [CW, MV1, Ki, MV2, MV3|, and rook polynomials [MV4|. 
Signed pattern avoidance in the hyperoctahedral group proved to be a useful lan¬ 
guage in combinatorial statistics defined in type-1? noncrossing partitions, enumer¬ 
ative combinatorics |s|. B£], algebraic combinatorics [FK, BK, [B(], Mo, |r|. 
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Let 7 r £ S n and t £ Sk be two permutations. An occurrence of r in 7 r is a 
subsequence 1 < i\ < ii < ■ ■ ■ < ik < n such that (n ^,..., 7r,; fc ) is order-isomorphic 
to r; in such a context r is usually called a pattern. We say that 7 r avoids t, or is r- 
avoiding, if there is no occurrence of r in 7 r. The set of all r-avoiding permutations 
in S',,, is denoted by S'n(r). For an arbitrary finite collection of patterns T, we say 
that 7 r avoids T if 7 r avoids any t £ T; the corresponding subset of S n is denoted by 
S n (T). The first case examined was the case of permutations avoiding one pattern 
of length 3. Knuth @ found that |5„(r)| = C n for all t £ S 3 , where C n is the nth 
Catalan number. Later, Simion and Schmidt [SS] found the cardinalities of |<S I „(T)| 
for all T C S 3 . 


The hyperoctahedral group B n is an analog of the symmetric group S n . Let 
us view the elements of B n as signed permutation b = 6162 ■ ■ - b n in which each 
of the symbols 1,2 ,n appears once, possibly barred. Thus, the cardinality of 
B n is n!2 n . Simion jsj] was looking for the analogs of Knuth’s results for B n ; she 
discovered that for every 2 -letter signed pattern r; the number of r-avoiding signed 
permutations in B n is Y^j =0 (”) j- Besides, Simion [jS|] found the number of all 
signed permutations in B n avoiding double 2-letter signed patterns in B 2 . This in¬ 
vites us to define a further generalizations for avoiding a pattern in S n and avoiding 
a signed pattern in B n . 

Following [|M2| (see also jSt|), the group Sn 1 = S n l C r where C r is the cyclic 
group of order r, is an analog of the symmetric group (S n ) and of the hyperoctahe¬ 
dral group (B„). We will view the elements of the set Sn ' 1 as coloured permutations 
<p = (<p 1 , (f> 2 , ■ ■ ■, <t>n) in which each of the symbols 1,2 ,... ,n appears once, coloured 
by one of the colours 1 , 2 ,..., r (more generally, we denote by the set of 

all permutations of the symbols a \,..., a n where each symbol appears once and is 
coloured by one of the colours Si,..., s r ). Thus, Sn^ = S n , Sn ' 1 = B n , and the car¬ 
dinality of Sn'* is n\r n . The absolute value notation means \(j>\ is the permutation 
(|(/>i|,..., \4>n\) where \(f>j\ is the symbol which appear in (f> at the position j. An 
example (f> = (1^, 3®, 2^i) is a coloured permutation in S^\ and \<j)\ = (1,3,2). 

Let $ = (r} Sl \ ..., rl Sk ' > ) £ S[ r \ and ip = (a^,..., a„ n *) £ Sn*; we say that 
ip contains cp (or is ^-containing) if there is a sequence of k indices, 1 < i\ < *2 < 
■ ■ ■ < ik <n such that the following two conditions hold: 


(i) (a^,..., cti k ) is order-isomorphic to \<p\; 

(ii) Vi j = Sj for all j = 1 , 2 ,..., k. 

Otherwise, we say that ip avoids cp (or is ^-avoiding). The set of all ^-avoiding 

coloured permutations in Sn * is denoted by Sn*(cp), and in this context <p is called 

a coloured pattern. For an arbitrary finite collection of coloured patterns T, we say 

(V) 

that ip avoids T if ip avoids any (p £T; the corresponding subset of SP ’ is denoted 
by Sn*(T). As an example, ip = (l^, 2^, 3^) £ S^ 2 * avoids (l^^ 1 )); that is, 

ipesi 2) (( i (1) ,2«)). 



COLOURED PERMUTATIONS CONTAINING AND AVOIDING CERTAIN PATTERNS 


In this note, we present an analogs of Mansour’s results for avoiding and con¬ 
taining certain patterns in S n (see [ Ml |), and Simion’s results for avoiding signed 
patterns in B n (see [S, Sec. 3]). 


2. Coloured permutations avoiding Tnh) 

Let Id be any subset of {1,2,..., r} of d elements, and let us define T™ r {I d ) be 

the set of all coloured permutations </> € S^' such that (p i = m^ where c £ Id ; 
that is, 

T^r(Id) = U W e S k ] \^ = ^ (C) }' 

ce/d 

Theorem 2.1. Let k,r > 1, n > k, and k > m > 1. Then 

n 

\SP(T£ r (I d ))\ = ( k - l)!r fe—1 []((r - d)j + (k 1 )d). 

j=k 

Proof. Let G n = Sn\TJT r (I d )), and define the family of functions fh, c ■ Sn ^ — >• 
Snh by: 

( , when i = 1 

[fh,c{<t>)]i = < 4>i-h when |0i_i| <h 

{ (|4_i| + when > h 

(r) 

for every i = 1,..., n + 1 , <f> £ Sh , 1 < c < r and h = 1,..., n + 1, where a* is the 
colour of the symbol [</>,[ in </>. 


From this we see that if <f> £ G n , then 

fn+l,cj (0)i fn,Cj (</>) i •••? fn-\-m— fc+2,c j'(^),/l,c 3 '(0),-,/m-l,C;,-(0) G G n+ 1 

for all ? = 1,2,..., c?, and fh C (<P) £ G n +i for all c 4 I d and /i = 1, 2,..., n + 1. so 
((* - l)d+ (r - d)(n + !)) |gT| < |G„ti| where n > fc. 

Assume that ((fc — l)d + (r — d)(n + 1)) • \G n \ < |G„+i|. Then there exists a 
coloured permutation ip £ G n +1 such that to < j^il < n + m —fc + 1 and the symbol 
coloured by c £ I dl so there exist fc —1 positions 1 < i\ < ■ ■ • < ik-i < n +1 such 
that the subsequence (f>i, fa,..., is contains one of the patterns in TJT^Id), 
which contradicts the definition of G n+ i. So ((fc — l)d+(r — d)(n+l))-|G n | = |G ra+ i| 
for n > k. Besides |Gfc| = (rk — d){k — l)!r fc_1 (from the definitions), hence the 
theorem holds. □ 


Example 2.2. (see [Ml, Th. 1]) Let T™ = T™ 1 ( 1) and k > m > 1. Theorem 2.1 
yields for all n > k that 

\S„{T^)\ = {k~ l)!(fc - i) n ~ k +\ 


Example 2.3. ( see [H, Sec. 3]) Theorem 2.1 yields for all n> k > m> 1 that 


\S^(T^ 2 (1))\ 

So, for k = 2 we have [||, Eq. 47]. 


(n + k — 1)! 

n?=i(2i-l)‘ 
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Example 2.4. (see (M2, Cor. 4.2]) Theorem 2.1 yields for k = 2, m = 1, and 
Id. = {1} that 

n 

i^ ) (T 2 v(D)i=n( i +^- 1 ))- 

3 = 0 


CoroHary 2.5. Let k, r > 1, and k > b > a > 1. For n > k 

n 

\S^(U b m= aT^ r (I d ))\ = (k- l)!r fc—1 1 ] (d(k + a -b-l)+j(r- d)). 


Proof. Let G n 
if either 


j = k 


Sn ( T™ r {Id )). From Theorem |2T| we get that (f G G n if and only 


fl,Cj {4 1 ) i • • • j fa — l,Cj (<(*) j fn+b—(k—2),Cj (</*)) ■ ■ • > fn+l,Cj {(f) G G n + 1 

for j = 1,2,... ,d, or fhA^) e G n+ i for h = 1, 2 ,..., n + 1, c £ I d . So |G„+i| = 
(d(fc + a — 6— l) + (r — d)(n + l))|G n j. Besides |Gfc| = (rk + d{a — b— l))(fc — l)!r fe_1 , 
hence the theorem holds. □ 


Example 2.6. Corollary \2.1[ yields for all n > 0 

|5( 2 ) (T fc 1 o(l)UT fe 2 2 (l))|=2 fc - 1 n!. 


This example invite us to generalize. By use Corollary |2.7| we get the following. 
Corollary 2.7. Let k,r > 1, and n> k. Then 

\SP(U k m=1 TZ r (I d ))\ = r k -\r - dY +1 ~ k n\. 

3. Avoiding T^ r {I d )\{(f} and containing (f exactly once 

Let M™ r ((j), I d ) = T^ r {I d \{cf}, for cf e T™ (I d ). We denote by {T™ r (J d ); r) 
the set of all permutations in Sn ' 1 that avoid MJfniff, I d ) and contain <f exactly 


once. 


Theorem 3.1. Let k,r > 1, and n> k. Then 

n n 1 

= nw* — 1) + (r — d)i) -Y. sk-l K (r - d),- 

j=fe j=k ' ' V 

/or all (f G T^ r (I d ). 

Proof. Let a G Sn\T£ r (I d ); <f), and let us consider the possible values of if\: 

1. \ifi\ is coloured by colour c £ Id- Evidently if G Sn\T£ r (I d )', 4>) if and only 
if <f avoids M™ r ((f,I d ) and contains <f exactly once. 

2. \ifi\ > n — k + 2 is coloured by c G I d . Evidently if G Su\t£ r (I d ); (f) if and 
only if (f avoids MJT r ((f : I d ) and contains <f exactly once. 
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3. \ip\\ < n — k is coloured by c 6 Id- Then there exist 1 < i\ < ■ ■ ■ < 
ik < n such that (ipi, ip^ , ■ ■ ■, ipi k ) is a coloured permutation of the sym¬ 
bols n,..., n — k + 1, a\ coloured by any colours such that ipi coloured by 
c G Id- For any choice of k — 1 positions out of i\,..., ik, the corresponding 
coloured permutations proceeded by |y/r|, is containing some coloured pattern 
in Tl r (Id)- Since %p avoids MJP r ((p, Id), it is, in fact, order-isomorphic to </>. 
We thus get at least k occurrences of <p in ip, a contradiction. 


4. \xpi\ = n — k + 1. Then there exist 1 < < • • • < i-k-i < n such that rj = 

(ipi , ipn ,..., ipi k _ 1 ) is a coloured permutation of the symbols n, ..., n — k + 1 . 
As above, we immediately get that rj is order-isomorphic to i p. We denote 
by A n the set of all coloured permutations in Sn\T^ r (Id); (p) such that the 
symbol \(p\\ is n — k + 1 and coloured by c G Id, and define the family of 
functions f h :A n -> by: 

( l(°), when i = h 

[fh,c(P)]i = S (|AI + l) (ai) , when i < h , 

[ (|/3j_i| + when i > h 

for every i = 1,..., n + 1, (3 G A n , h = 1,..., n + 1 and c = 1,..., r, where the 

symbol |/3,;| coloured by the colour cn. It is easy to see that for all p G A n , 


fn+l, Cj (P) i • • • i fn—k+3,c ,09) e -^■n+ 15 

and fh,c(/3 ) G A n+ 1 for c ^ Id and h = 2,. .., n (for ft, = 1 we added in the 
first case), hence (d(k — 1) + [n)[r — d))\A n \ < |A„ + i|. Now we define another 
( r ) 

function g : A n+ i —> Sn by: 



(lAl-i) (a<) , 
(IA+i| - i) (0i \ 


when i < ft 
when i + 1 > ft ’ 


where \p h \ = !,£ = !,... ,n, p G A n+1 . 


Observe that ft > n—k+3 such that \Ph\ coloured by c G Id, since otherwise 
already (Ph, Ph+ i> ■ ■ ■ ,Pn+i) contains a pattern from T^(Id), a contradiction. 
It is easy to see that g(P) G A n for all P G A n+ 1 , hence |A„ + i| < (d(k — 
1) + (r — d){n + l))|A n |. So finally, |A n+ i| = (d(k — 1) + (r — d)n)\A n \ and 
\A n \ = n"=fc( d ( fc - !) + (r - d)j), since \A k \ = 1. 

Since the above cases 1, 2,3,4 are disjoint we obtain 

n— 1 

l^ ) (T fe V(/ d );^)| = (d(A:-l) + (r-d)n)|5W 1 (T fe V(/ d );^)| + n( rf ( fc - 1 ) + ( r -^)- 

j=k 

Besides \Sj^\T^ r (Id)', cp)\ = 1, hence the theorem holds. □ 


Example 3.2. By Theorem 3.1 we get as follows. For any (p G T)) 2 (1) 




(n+l)! 1 

(2k — 2)! ^ j 

V ’ j— 2 k—l J 
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By the natural bijection between the set Sn (T^ r (Id)',(/>) and the set S„ (T^ r (I d )\ 0') 
for all 0 G Tl r (I d ), where 0' = (k + 1 - |0i|) (ai \ cii is colour of the symbol \(j>i\ in 
(j), i = 1, 2,..., k, hence by Theorem 3.1 we get the following. 

Corollary 3.3. Let k,r >1, and n> k. Then 


I SP{T* r {I d y, 0)| = n (d(k - 1) + (r - d)j) ■ 


j=k 


j=k 


d(k — 1) + (r — d)j ’ 


for all 0 G T% r (Id). 


4. Avoiding T ^ 1 (Id)\{(j)} and containing 0 exactly once, 2 < m < k — 1 

Now we calculate the cardinalities of the sets 0) where 2 <m< 

k ~ 1, 0 G T™ r (I d ). 

Theorem 4.1. Let r > 1, k > 3, and n > k + 1. Then 

n 

I SP(T£ r (I d y, 0)1 = n - !) + (r - d)j), 

j=k+1 

/or all 2 < m < k — 1, 0 G T™ r (I d ). 

Proof. Let G n = Sn\T™ r (I d )-,<f>), 0 G G n , and let us consider the possible values 
of 0 i: 

1. |0i | < m — 1 and coloured by c G /<j. Evidently 0 G G n if and only if 
( 02 ,..., 0 n ) avoids M™ r ( 0 , J^) and contains 0 exactly once. 

2. |0i >n — fc + TO + 1 and coloured by c G L. Evidently 0 G G n if and only if 
( 02 ,..., 0n) avoids M™ r ((f >, 7<j) and contains 0 exactly once. 

3. m < |0i | < n — k + m and coloured by one of the colours ci,... ,c d . By 
definition we have that \Gk\ = 1, so let n > k + 1. If m + 1 < |0i| then 
0 contains at least m > 2 occurrences of a pattern from TfT^Id), and If 
|0i I <n — k + m — 1 then 0 contains at least A: — m + 1 > 2 occurrences of a 
pattern from TJT r (I d ), a contradiction. 

4. |0i | coloured by a colour c £ I d . Evidently 0 G G n if and only if (0 2 ,..., 0 n ) 
avoids M™ r ((j), I d ) and contains 0 exactly once. 

Since the above cases 1,2, 3,4 are disjoint we obtain |G n | = ( d(k — 1) + (r — 
d)n)\G n -i\ for all n > k + 1 . Besides \Gk\ = 1, hence the theorem holds. □ 


Example 4.2. (see H) By Theorem f.l we get as follows. For any 0 G TfT 2 ( 1) 


l^ 2) (T fc m 2 (i);0)l 


(n + k — 1)! 
(2k - 1)! 


where 2 < m < k — 1, k > 3 and n > k. 
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